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EQUIPMENT HARDWARE RESOURCES 



PROCESSING DEVICE (E.G., CPU, PROCESSOR, ETC.) 
STORAGE DEVICE (E.G., RAM, ROM, CACHE, HARD DISK, ETC.) 
OUTPUT DEVICE (E.G., PRINTER, MONITOR, PLOTTER, ETC.) 
SCANNING DEVICE (E.G., SCANNER, SLIDE SCANNING DEVICE, ETC.) 
INPUT/OUTPUT DEVICE (E.G., FLOPPY DRIVE, NETWORK CONNECTION, ETC.) 



O 

o 



EQUIPMENT SOFTWARE RESOURCES 



OPERATING SYSTEM 

DEVICE DRIVERS 

IMAGE ANALYSIS APPLICATION 



O 
O 

o 
o 

! r J 



24 2 o 



FIG. 1 
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FIG. 3a 
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NEXT POINT 
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FIG. 3c 



30 



37 



32 
— M 



36 



34 

ho 



FIG. 3d 



r 



30 



32 



34 



36 



38 



F/G. 3e 




Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

Docket No. : COR-54/Serial No. : 09/803, 1 

Filed: March 9, 2001 

For: METHOD APPARATUS FOR" 

IMAGE ANALYSIS 
Express Mail #: EK708045024US 



4/30 



START FROM A PIXEL IN 
THE IMAGE (E.G., THE 
PIXEL IN THE UPPER-LEFT 
CORNER OF THE IMAGE) 



EXAMINE PIXELS SEQUENTIALLY TO 
FIND A CURRENT PIXEL HAVING A 
DESIRED INTENSITY (E.G., A 
CURRENT PIXEL HAVING AN 
INTENSITY THAT IS APPROXIMATELY 
ABOVE A THRESHOLD INTENSITY) 
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THE CURRENT PIXEL HAS 
THE DESIRED INTENSITY 
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IDENTIFY THE CURRENT PIXEL TO BE PART OF A NEW 

OBJECT OR PART OF A KNOWN OBJECT BASED ON 
PARTICULAR ADJOINING PIXELS (E.G., TWO ADJOINING 
PIXELS THAT WERE ALREADY EXAMINED, ONLY TWO 
EXAMINED PIXELS THAT ARE ADJACENT TO THE 
CURRENT PIXEL, ETC.) oeo . 



IDENTIFY THE 
CURRENT PIXEL TO 
BE PART OF A NEW 
OBJECT WHEN 
NEITHER ONE OF 
THE ADJOINING 
PIXELS ARE 
DETERMINED TO BE 
PART OF AN OBJECT 



IDENTIFY THE 
CURRENT PIXEL TO 
BE PART OF A 
KNOWN OBJECT 
WHEN AT LEAST ONE 
OF TWO ADJOINING 
PIXELS IS KNOW TO 
BE PART OF THE 
KNOWN OBJECT 



FIG. 3f 




Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

Docket No. : COR-54/Serial No. : 09/803,1 33 

Filed: March 9, 2001 

For: METHOD APPARATUS FOR 

IMAGE ANALYSIS 
Express Mail #: EK708045024US 



5/30 



NEW SPOT 

FIG. 4a 
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KNOWN SPOT 

FIG. 4b 
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KNOWN SPOT 

FIG. 4c 
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TWO KNOWN SPOTS 

FIG. 46 
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LIGHT INTENSITY RANGE 



FIG. 4e 



FIG. 4f 
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START FROM A PIXEL IN 
THE IMAGE (E.G., THE 
PIXEL IN THE UPPER-LEFT 
CORNER OF THE IMAGE) 



EXAMINE PIXELS SEQUENTIALLY TO 
FIND A CURRENT PIXEL HAVING A 
DESIRED INTENSITY (E.G., A 
CURRENT PIXEL HAVING AN 
INTENSITY THAT IS APPROXIMATELY 
ABOVE A THRESHOLD INTENSITY) 



THE CURRENT PIXEL HAS 
THE DESIRED INTENSITY 
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IDENTIFY THE CURRENT PIXEL TO BE PART OF A NEW 
OBJECT AND SEARCH RECURSIVELY STARTING FROM 
THE CURRENT PIXEL TO FIND OTHER PIXELS THAT ARE 
PART OF THAT NEW OBJECT (E.G., SEARCH OUTWARD 
REPEATEDLY FROM EVERY PIXEL THAT HAS A DESIRED 
INTENSITY TO FIND SUBSTANTIALLY ALL OF THE PIXELS 
THAT ARE PART OF THE NEW OBJECT) 



FIG. 5g 
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HOLE - FILLING 

FIG. 6b 



EDGE REJECTION 



FIG. 6a 
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FIG. 7a 



FIG. 7b 



FIG. 7c 



92 



DETERMINE SUM OF 
INTENSITIES IN EACH 
REGION 



94 



IDENTIFY A REGION TO 
INCLUDE AN OBJECT (E.G., 

A SPOT) BASED ON THE 
INTENSITY SUM FOR THAT 
REGION 
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SET THE INTENSITY SUM 

FOR REGIONS THAT 
OVERLAP THE IDENTIFIED 
REGION TO ZERO 



FIG. 8a 
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DETERMINE AN INTEGRATED INTENSITY 
FOR EACH OF A PLURALITY OF 
REGIONS IN THE IMAGE 



SORT THE INTEGRATED INTENSITIES 
FOR THE REGIONS IN DESCENDING 
ORER 



& 

CLAIM SOME OF THE REGIONS TO CONTAIN 
272 J SPOTS BASED ON DETERMINING THE HIGHEST 
INTEGRATED INTENSITY AMONG THE REGIONS 
WHILE SETTING THE INTEGRATED INTENSITIES 

FOR THE REGIONS THAT OVERLAP EACH 
CLAIMED REGION TO A DESIRED INTENSITY (E.G., 
ZERO INTENSITY) 



Applicants: 




Express Mail #: 



Cameron W. Tanner and Patrick D. \ 
Tepesch 

COR-54/Serial No.: 09/803,133 
March 9, 2001 

METHOD APPARATUS FOR 
IMAGE ANALYSIS 
EK708045024US 



11/30 




APPLY THRESHOLDING IN A 
PORTION OF A REGION (E.G., A 
REGION USED IN INTEGRATION) 

DETERMINE A THRESHOLd"rANGE "I 
FOR THE PORTION ' 



± 

DETERMINE THE BEST OBJECT (E.G., THE 
BEST SPOT) IN THE REGION 



± 

DETERMINE CHARACTERISTICS OF THE 
BEST OBJECT 



FIG. 10 
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APPLY 
THRESHOLDING 
. ^ 



DETERMINE 
CHARACTERISTICS 
OF SPOTS 
(E.G., 
SIZE) 
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DETERMINE WHETHER 
TO DISCARD BASED ON 
CHARACTERISTICS 



DISCARD REGION BASED ON A 
PARTICULAR CHARACTERISTICS OF THE 
SPOTS, SUCH AS SIZE (E.G., DISCARD BY 
SETTING THE INTENSITY FOR THE 
REGION TO BE ZERO, DISCARD BY 
IGNORING THE REGION, ETC.) 



FIG. 11c 
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FIG. 11 d 
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FIG. 12a 
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THRESHOLDING 
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DETERMINE 
CHARACTERISTICS. 
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FIG. 12b 
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DETERMINE WHETHER TO 

USE BASED ON 
CHARACTERISTIC SUCH 
AS DISTANCE 




DISCARD BASED ON CENTER 
OF REGION NOT BEING 
WITHIN SOME MINIMUM 
DISTANCE OF SPOT CENTER 



FIG. 12c 




Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

Docket No.: COR-54/Serial No.: 09/8^ 

Filed: March 9, 2001 

For: METHOD APPARATUS! 

IMAGE ANALYSIS 
Express Mail #: EK708045024US 



14/30 



136 



^ r^134 
138 ! 



MOVE REGION TO 
BE CENTERED ON 
CALCULATED 
SPOT CENTER 
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IDENTIFY THAT A REGION THAT 
INCLUDES A TYPE OF OBJECT 
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MOVE REGION TO CENTER ON 
DETERMINED OBJECT CENTER 
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YES 
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DETERMINE WHETHER REGION 
CENTER IS CONVERGING TO 
OBJECT CENTER (E.G., BY THE 
NUMBER OF ITERATIONS) 



NO 



NO 
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DETERMINE A CENTER FOR 
THE OBJECT IN THE REGION 
(E.G., USING THRESHOLDING) 



DETERMINE IF REGION CENTER 
IS WITHIN TOLERANCE OF 
OBJECT CENTER 



YES 



> STOP 
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DETERMINE AVERAGE 
INTENSITY PROFILE 



± 

APPLY INTENSITY PROFILE 
TO REGIONS IN LOCATING 
OBJECTS (E.G., REPEAT 
INTEGRATION USING 
PROFILE, ETC.) 



FIG. 16 
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INTENSITY 
PROFILE OF AN 
AVERAGE OBJECT 



FIG. 17a 
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DETERMINE WHERE SPOTS 
ARE LOCATED (E.G., USING 
THRESHOLDING, 
INTEGRATION, ETC.) 
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DETERMINE RELATIONSHIP OF 
GRID POINTS THAT FORM A 
GRID THAT WAS USED IN 
PLACING SPOTS 
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MAP SPOTS TO GRIP POINTS 



FIG. 18 
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DETERMINE A DISTANCE 
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DETERMINE A PLURALITY 
UNIT CELL SPOT PITCH 
VECTORS 



DETERMINE AN ACTUAL 
UNIT CELL SPOT PITCH 
(E.G., AVERAGE OF UNIT 
CELL SPOT PITCH 
VECTORS) 



DETERMINE RELATIONSHIP 
OF GRID POINTS TO EACH 
OTHER BASED ON ACTUAL 
SPOT PITCH 
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DETERMINE A UNIT CELL 
SPOT PITCH VECTOR FROM 
A CURRENT SPOT TO A 
NEAREST NEIGHBORING 
SPOT (E.G., NEAREST SPOT 
TO THE RIGHT) 



DETERMINE WHETHER THE S~ 
LENGTH OF THE VECTOR IS 
WITHIN TOLERANCE 



FIG. 22 



FIG. 21 
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NEAREST NEIGHBOR WITHIN 
TOLERANCE FOR SPOT PITCH VECTOR 




FIG. 23a 



NEAREST NEIGHBOR NOT WITHIN 
TOLERANCE FOR SPOT PITCH VECTOR 




FIG. 23b 
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DETERMINE LOCATIONS OF SPOTS 
IN ROWS AND COLUMNS 



DETERMINE PAIRS OF SPOTS TO 
USE IN DETERMINING AN AVERAGE 
SPOT PITCH VECTOR BASED ON 
WHICH ROW (OR COLUMN) THE 
SPOTS ARE LOCATED IN (E.G., SORT 
SPOTS BASED ON ROWS AND 
DETERMINE PAIRS BASED ON 
LOCATION OF ROWS FOR SPOTS) 



FIG. 24 



Applicants: 
^^^^etNo.: 

Express Mail #: 



Cameron W. Tanner and Patrick D. 
Tepesch 

COR-54/Serial No.: 09/803,133 
March 9, 2001 

METHOD APPARATUS FOR 
IMAGE ANALYSIS 
EK708045024US 




25/30 



MAP GRID POINTS TO SPOTS BASED 
ON A DETERMINED SPOT PITCH 
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DETERMINE SUBGRIDS OF THE GRID 



)k 

DETERMINE WHICH SPOTS HAVE 
BEEN MAPPED TO SUBGRIDS 
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DETERMINE A SUBGRID SPOT PITCH 
BASED ON WHICH SPOTS ARE IN 
THAT SUBGRID 
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MAP GRID POINTS TO SPOTS BASED 
ON SUBGRID SPOT PITCH VECTORS 
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PROVIDE A SLIDE HAVING A HIGH 
DENSITY ARRAY OF SPOTS THAT 
INCLUDES MATERIALS FROM A 
PLURALITY OF SOURCES (E.G., 
CANCEROUS AND NONCANCEROUS 
TISSUE WITH A DIFFERENT 
FLUORESCENT TAG FOR EACH) 



z: 
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GENERATE IMAGES BASED ON THE 
SLIDE (E.G., A DIFFERENT IMAGE 

BASED ON CHARACTERISTICS OF 
EACH FLUORESCENT TAG) AND 
LOCATE SPOTS IN EACH IMAGE 
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ALIGN IMAGES BA! 
OF SPOTS (E.G., 
TRANS 


5ED ON LOCATION 
USING A MATRIX 
FORM) 
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FIG. 27c 
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DETERMINE A COMPOSITE IMAGE 
(E.G., COMBINE LIGHT INTENSITY OF 
PIXELS IN EACH IMAGE THAT ARE IN 
A SAME LOCATION) 
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LOCATED SPOTS IN THE 
COMPOSITE IMAGE 
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ANALYZE SPOTS IN THE ALIGNED 
IMAGES BASED ON LOCATIONS OF 
SPOTS IN THE COMPOSITE IMAGE 



FIG. 26b 
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FIG. 27e 





~FIG^27f 




Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

[ocket No.: COR-54/Serial No. : 09/803. 1 33 

led: March 9, 2001 

METHOD APPARATUS FOR 
IMAGE ANALYSIS 
Express Mail #: EK708045024US 



28/30 



^-300 

OBTAIN IMAGE INFORMATION (E.G., 
LOCATION, SIZE, SHAPE, SPACING 
MORPHOLOGICAL CHARACTERISTICS, 
ETC.) OF A NEW SUBJECT OF CONCERN 
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APPLY INFO. FROM IMAGE TO AN 

APPROPRIATE DATABASE OF 
INFORMATION (E.G., DATABASE OF 
INFORMATION ABOUT KNOWN SUBJECTS) 
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PROVIDE AN IDENTIFICATION FOR, A 
NATURE OF, A QUALITY OF, A 
CHARACTERISTIC OF, ETC. OF THE NEW 
SUBJECT (E.G., DISPLAY IDENTITY OF NEW 
SUBJECT) 



FIG. 28 



Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

COR-54/Serial No.: 09/803,133 
March 9, 2001 

METHOD APPARATUS FOR 
IMAGE ANALYSIS 
Express Mail #: EK708045024US . 




29/30 




Applicants: Cameron W. Tanner and Patrick D. 

Tepesch 

COR-54/Serial No.: 09/803,133 
March 9, 2001 

METHOD APPARATUS FOR 
IMAGE ANALYSIS 
Express Mail #: EK708045024US 



30/30 



CM 



